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Remote visualization of large 3D scientific datasets 

Scientific simulation lead to gigantic 3D data (1 billion elements) 
Data produced in HPC center but analysed by remote users 
How to insure collaborative interactivity ? 



High performance 
computing centers 






Different networks 
Different graphic capabilities 
Different user viewpoints 



_ 





How to transmit efficiently large datasets? 
How to adapt the 3D data to remote client? 





Our proposal: A 3D streaming framework 



The idea is to adapt the Level Of Detail according to the user, 
the bandwidth, the device capabilities 




High performance PC Mobile device 



High bandwidth network Wireless network 



Our framework: 




A progressive mesh compression method for 3D mesh with colors 

Adaptation mechanisms dealing with different constraints (network 
bandwidth, display capability, etc.) 

A solution for the integration into X3D 
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The 3D data to visualize 




File size: X3D {<lndexedFaceSet>) = 953 KB 

ZIP = 219 KB 



Using mesh compression [Lee et al., 2010] = 27KB 



Progressive mesh compression 



Encoding 




► 




► 



X3D = 953 KB 



27 KB 



Size reduction 



Decoding 
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Level of Details 
management 



Progressive mesh compression 



The mesh is iteratively simplified.... 





Encodin 




..and the information necessary to reverse the process are 
encoded 

Original mesh = Base mesh + sequence of refinement 



Progressive Meshes - Hoppe 1996 
Progressive Forest Split - Taubin et al. 1998 
Valence-driven Approach -Alliez and Desbrun 2001 
Kd-tree Decomposition - Gandoin and Devillers 2002 
Octree Decomposition - Peng and Kuo 2005 
Incremental Parametric Refinement - Valette et al. 2009 




Color 



Lee et al., 2010 
Cirio et al. 2010 
Cai et al, 2007 
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The compression algorithm 




Based on iterative simplification [Alliez and Desbrun, 2001] 
Adaptive quantization + color prediction scheme [Lee et al. 2010] 




Cur ra nt gal e Current gate 



Iterative decimation of a set of independent vertices 
When a vertex is removed the patch is retriangulated 
Connectivity (C), geometry (G) and color (CI) are encoded 



Base 
mesh 


G 


C 


CI 


Q 


C 


CI 



Level 1 Level 2 Level 3 ™. Level n 7 



L Decoding example. 
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CI 


mesh 





Level 1 Level 2 Level 




Original X3D size = 953 KB 



CI 
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8 





Decoding example 



[Lee et al., 



Original = 2743KB 





Base mesh 




Compression results 




3D models coming from Fluid 
dynamics and geophysics 

Compression ratio around 3-4% 
Gzip gives around 15-20% 

Whole decompression time between 
0.15 seconds (4.3 Kvertices) and 
6 seconds (123 Kvertices) 

Number of levels between 10 and 26 



Name 


Original t KB) | 


Compressed (KB) 


Ratio | 


velocity-CP 


7739 


227,9 


2.94% 


velocity 


2979 


83.4 


2.8-3% 


radiator 953 


27,0 


2,83% 


radiatorJso 713 


19,6 


2,75% 


vistcurb-CP 


354 


16.0 


4.51% 


tank 


10065 


266,0 


2,64% 
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Our adaptation/streaming framework^™ 



Principle 



Internet 




HTTP(S) 

server 




Mesh .t?Ds 



I 
I 

I 



I 
■ 

I 



Client 




Visualisation 
device 



Download (using HTTP protocol) and render at each instant the 
most relevant level of details of each 3D object 

How to chose the best Level Of details? It depends on: 

□ The network bandwidth 

□ The terminal graphic capabilities 

□ The user viewpoint. 




Our adaptation parameters 



□ Total downloading time, 

□ Total quantity of memory taken by all LOD data, 

□ 3D scene rendering time, 

□ Element distinction metric 



Based on off screen rendering 

1 . Select random triangles 

2. Filled mode rendering: 

Pixel counting — ► n 

3. Line mode rendering: 

Pixel counting — ► n 

4. Metric computation : 



1 



ED 



n 



n 



i 






^The adaptation algorithm^ 









Triggered by events (view point change, object visibility 
modifications, object mesh refinement or coarsening ...) 

At each event, 3 choices (driven by the rendering time): 

□ Do nothing. 

□ Coarsen the mesh with the highest element distinction metric 

(too much details regarding the resolution) 

□ Refine the mesh with the minimal element distinction metric 
with the constraints to not exceed: 

■ The maximum total memory used, 

■ The maximum total downloading time, 

■ And the maximum element distinction metric value. 
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A node <ProgrTriSet> defines a progressive 3D model 
Nodes <Progrl_OD> provide the URLs of every LOD 



The compression has been already done offline 

The client receive the X3D file then he choses the level to 
download according to our adaptation algorithm 



<ProgrTriSet> 



<ProgrLOD level="1" url="http://collaviz.org/lod1.ps" /> 
<ProgrLOD level="2" url="http://collaviz.org/lod2.ps" /> 
<ProgrLOD level="3" url="http://collaviz.org/lod3.ps" /> 
<ProgrLOD level="4" url="http://collaviz.org/lod4.ps" /> 




</ ProgrTriSet> 



Similar to the VRML extension from Fogel et al., WEB3D 2001 





Demonstration using 



Thermal analysis of bolts of a french pw 
core internal baffle structure 

1. 1 billions elements, 40GB of 3D data 
Need a 96GB RAM workstation 



Client on a station with 2,8 Ghz proc. ai 
a NVI Dl A Quadro FX 580. 

Visualization of a 460Kfacets data. 

The client starts with a global view point 
and then zooms toward the model 



1 ) Level of detail 29/34 (27% of the dat 
rendering time: 45ms 

2) Level of detail 32/34 (52% of the dat 
Rendering time: 230ms 



3) Level of detail 34/34 (1 00% of the 
data) Rendering time: 266ms 



a Real case 



i) 



3) 




50412 triangles 






150650 triangles 



c 



J 



460192 triangles 5 





^Conclusion^ 









Adaptive and progressive streaming framework dedicated 
to remote scientific visualization 

□ Progressive compression for 3D meshes with color 

□ Adaptation mechanisms 

□ X3D integration 



What next? 

□ Random access decompression 

□ Other associated data 



This work has been founded by French National Research Agency (ANR) through 



COSINUS program (project COLLAVIZ) 

The 3D models presented in these slides are courtesy of EDF 




THANK YOU! 



